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Response to Applicants' Amendment and Arguments 

1 . The amendment filed January 6, 2005, has been entered and made of record. 
Claim 28 has been amended. Claims 1-30 are pending. 

In response to the amendment, the objection to claim 28 because of an 
informality is withdrawn. 

Applicants' arguments have been fully considered, but they are not deemed to be 
persuasive for at least the following reasons. 

On page 10, first through fourth paragraphs, and page 12, first paragraph, 
Applicants argue that Tsai does not disclose using a model defined by a set of one or 
more model primitives representative of large scale structures of an archetype because 
Tsai's lines are of infinite length, and since lines can provide no information as to where 
along this infinite length edge points are situated, Tsai cannot model primitives that 
represent large scale structures of an archetype. Applicants on page 1 1 attempt, by 
way of diagrams, to show their point. The Examiner disagrees. While Tsai does utilize 
lines as primitives, Tsai does model polygonal objects (I.e., the archetypes) using the 
lines. See for example, the abstract, as well as the first paragraph of section 6. Tsai 
does address the "non-uniqueness" aspect raised by Applicants, in section 5.3, such 
that a line segment can be determine to uniquely belong to a model instance. 

On page 13, first and second full paragraphs, with regard to claim 28, Applicants 
argue that Tsai does not disclose sampling each model primitive at two or more 
respective sample locations, mapping each sample location to a respective sample bin 
of a hash table, and inserting a reference to the respective model primitive in the 
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sample bin. The Examiner disagrees. Every line (mentioned in section 4) must be 
represented by at least two points, i.e., samples, having respective locations. Note from 
section 5.1 that each hash table entry (i.e., a bin) records, among other things, an 
identifier of the line being encoded. Thus, mapping and inserting take place. 

On page 14, first paragraph, and page 15, first and second full paragraphs, with 
regard to claim 1 , Applicants argue that Baek does not disclose the step of, for each 
target primitive: identifying any model primitives that at least partially match the target 
primitive because in Baek, only model features that match the image feature so closely 
that all parameters of the image feature fall in the same quantization units as those of 
the model feature is identified. First, if Baek is determining model features that match 
the image feature closely, as Applicants contend, they at least partially match. 
Second, Baek seeks to match the object and the model based on extracted primitives 
(from subsection B, "Matching" on page 2370). The fact that Baek is identifying model 
primitives that match target primitives, inherently means that they are identifying those 
that at least partially match. 

On page 15, fifth full paragraph, to page 16, second paragraph, with regard to 
claim 28, Applicants argue that Baek does not disclose sampling each model primitive 
at two or more respective sample locations; mapping each sample location to a 
respective sample bin of a hash table, and inserting a reference to the respective model 
primitive in the sample bin because each local feature in Baek is mapped to a single 
address in memory and a local feature record is stored at this single address. First, if 
Baek did in fact map a feature to a single address in memory, this does not preclude 
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sampling at two or more locations, or mapping each sample location. Further, in Baek 
(see page 2369, right column second through third paragraphs), digitizing by equal 
division of the space is itself a sampling. The hash function transforms the key 
(representative of the feature data) into the address space, thus performing mapping. 
Storing of the records corresponds to the inserting step. 

In the paragraph bridging pages 16 and 17, the first, third and fourth full 
paragraphs of page 17, as well as the paragraph bridging pages 17-18, with regard to 
claim 1 , Applicants argue in essence that Procter does not disclose the step of, for each 
identified model primitive, calculating a figure of merit indicative of a degree of 
correspondence between the target primitive and the model primitive, because the 
peaks referred to by the Examiner are not a figure of merit indicative of a degree of 
correspondence. Applicants contend that the peaks are not a figure of merit because a 
peak in the vote array corresponds to an accumulation of votes for a particular (model, 
viewpoint) pair. The Examiner disagrees. A peak is an accumulation of votes 
(paragraph under Fig.1 , on page 890). Each vote has associated with it a model/scene 
transformation and a triplet of model/scene line correspondences. Therefore, a peak 
would correspond to the number of votes, and thus be a figure of merit indicative of a 
degree of correspondence. 

On page 18, fourth full paragraph, and the paragraph bridging pages18 and 19, 
with regard to claim 28, Applicants argue that Procter does not disclose, sampling each 
model primitive at two or more respective sample locations, mapping each sample 
location to a respective sample bin of a hash table, and inserting a reference to the 
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respective model primitive sample bin, because in Procter, an edge-triple is mapped to 
a single hash table bin and an entry is added to the single hash table bin, and that the 
parameters a and (3 of the edge-triples are used to index a single bin in a 2D hash table 
The Examiner disagrees. While sampling is provided by the projections (see page 890, 
right column, first paragraph), as the Examiner contends, the Examiner points out that 
each entry in a hash table bin is represented by (model, viewpoint, triple ID). Note that 
each edge triple can be present (and thus sampled) in more than one viewpoint (in the 
figure, one viewing direction at 20 degrees is shown, for example). Each viewpoint 
would thus yield a respective sample bin in the hash table for a given sampling of a 
given edge-triple. 

Claim Rejections - 35 USC § 102 

2. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
states. 

3. Claims 1-5, 9, 18 and 28 are rejected under 35 U.S.C. 102(b) as being 
anticipated by the article, "Robust Affine Invariant Matching with Application to Line 
Features" by Tsai. 

As to claim 1 , Tsai discloses a method of pattern matching for recognition of 
objects within an image using a model defined by a set of one or more model primitives 
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representative of large scale structures of an archetype, the method comprising steps 
of: 

deriving at least one target primitive representative of a large scale structure of 
the image (page 393, right column, first paragraph); and 
for each target primitive: 

identifying any model primitives that at least partially match the target primitive 
(page 393, right column, under "The recognition stage"; section 5.2); and 

for each identified model primitive, calculating a figure of merit indicative of a 
degree of correspondence between the target primitive and the model primitive (section 
5.2). 

As to claim 2, Tsai method as claimed in claim 1, wherein the step of deriving at 
least one target primitive comprises steps of: 

detecting geometric features within the image (components of the lines, i.e., 
points); 

analyzing the detected geometric features to find large scale stmctures of the 
image (via the Hough transform; page 293, right column, first paragraph, and first 
paragraph of section 3; the Hough transform finds edges/lines in an image); 

approximating each large scale structure with at least one respective primitive; 
deriving a basis from at least one of the primitives (via the Hough transform, page 293, 
right column, first paragraph, and first paragraph of section 3; basis is formed by three 
lines, section 2); and 

representing each of the primitives as invariants in the derived basis (section 2). 
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As to claim 3, Tsai discloses a method as claimed in claim 2, wherein the step of 
approximating each large scale structure comprises a step of mapping a respective 
primitive through at least a sub-set of the geometric features forming the large scale 
structure (note section 3; each line detected by the Hough transform approximate the 
actually lines since they may "deviate slightly from the true values", and a primitive goes 
through at least the two endpoints of the line). 

As to claim 4, Tsai discloses a method as claimed in claim 3, wherein each 
primitive comprises a straight line-segment (page 293, right column, first paragraph). 

Claim 5 depends from claim 4. Claim 4 refers to a straight line-segment and a 
curve segment. The rejection of claim 4 has selected the straight line-segment 
limitation. Therefore, claim 5 is also rejected as it merely further limits a non-selected 
limitation. 

As to claim 9, Tsai discloses a method as claimed in claim 2, wherein the step of 
deriving a basis comprises steps of: calculating an origin of a respective local 
coordinate system, and calculating an orientation of the respective local coordinate 
system (section 2). 

Regarding claim 18, Tsai discloses a method as claimed in claim 2, wherein the 
step of representing each of the primitives as invariants in the derived basis comprises 
a step of calculating parameters of each primitive relative to a respective local 
coordinate system of the derived basis (section 5.1 , step 1 ). 

As to claim 28, Tsai discloses a method of deriving a model use in a pattern 
matching method in accordance with claim 1 , the method comprising steps of: 
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deriving at least one model primitive representative of large scale structures of an 
archetype (section 2); 

sampling each model primitive at two or more respective sample locations 
(section 4); 

mapping each sample location to a respective sample bin of a hash table 
(section 5,1); and 

inserting a reference to the respective model primitive in the sample bin (section 

5.1). 

4. Claims 1 and 28 are rejected under 35 U.S.C. 102(b) as being anticipated by the 
article, "Occluded Object Recognition Using Extended Local Features and Hashing" by 
Baek et al. (hereinafter "Baek"). 

With regard to claim 1 , Baek discloses a method of pattern matching for 
recognition of objects within an image using a model defined by a set of one or more 
model primitives representative of large scale structures of an archetype, the method 
comprising steps of: 

deriving at least one target primitive representative of a large scale structure of 
the image (see section II, the corners, arcs, parallel lines, or comer-arcs); and 

for each target primitive: 

identifying any model primitives that at least partially match the target primitive 
(page 2370, left column, subsection "B. Matching"); and 

for each identified model primitive, calculating a figure of merit indicative of a 
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degree of correspondence between the target primitive and the model primitive (page 
2370, left column, subsection "B. Matching"; the figure of merit is the "compatibility"). 

As to claim 28, Baek disclose a method of deriving a model use in a pattern 
matching method in accordance with claim 1, the method comprising steps of: 

deriving at least one model primitive representative of large scale structures of an 
archetype (e.g., section II, e.g., corners, arcs, etc.); 

sampling each model primitive at two or more respective sample locations (page 

2369, right column, third paragraph); 

mapping each sample location to a respective sample bin of a hash table (last 
paragraph of page 2369); and 

inserting a reference to the respective model primitive in the sample bin (page 

2370, left column, paragraph before "B. Matching"). 

5. Claims 1-5, 9-11, 15, 18 and 28 are rejected under 35 U.S.C. 102(b) as being 
anticipated by the article, "Foresight: Fast Object Recognition Using Geometric Hashing 
with Edge-Triple Features" by Procter et al. (hereinafter "Procter"). 

With regard to claim 1 , Procter discloses a method of pattern matching for 
recognition of objects within an image using a model defined by a set of one or more 
model primitives representative of large scale structures of an archetype, the method 
comprising steps of: 

deriving at least one target primitive representative of a large scale 
structure of the image (the edge triples, section 3,first paragraph); and 
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for each target primitive: 

identifying any model primitives that at least partially match the target primitive 
(page 890, paragraph under Fig.1); and 

for each identified model primitive, calculating a figure of merit indicative of a 
degree of correspondence between the target primitive and the model primitive (page 
890, paragraph under Fig.1 ; the peaks are the figure of merit). 

As to claim 2, Procter discloses a method as claimed in claim 1 , wherein the step 
of deriving at least one target primitive comprises steps of: 

detecting geometric features within the image (e.g., lines, first paragraph of 
section 3); 

analyzing the detected geometric features to find large scale structures of the 
image (e.g., the connected straight edges of the object, first paragraph of section 3); 

approximating each large scale structure with at least one respective primitive; 
deriving a basis from at least one of the primitives (first and third paragraphs of section 
3); and 

representing each of the primitives as invariants in the derived basis (this is the 
inherent purpose of the basis, as discussed with respect to the known use of point 
bases, page 890, left column, first three lines). 

As to claim 3, Procter discloses a method as claimed in claim 2, wherein the step 
of approximating each large scale structure comprises a step of mapping a respective 
primitive through at least a sub-set of the geometric features forming the large scale 
structure (note Fig.1 ). 



Application/Control Number: 09/978,000 



Art Unit: 2623 



Page 1 1 



As to claim 4, Procter's primitive comprises three straight line segments, 
therefore it comprises a straight line-segment. 

Claim 5 depends from claim 4. Claim 4 refers to a straight line-segment and a 
curve segment. The rejection of claim 4 has selected the straight line-segment 
limitation. Therefore, claim 5 is also rejected as it merely further limits a non-selected 
limitation. 

As to claim 9, Procter discloses a method as claimed in claim 2, wherein the step 
of deriving a basis comprises steps of: calculating an origin of a respective local 
coordinate system and calculating an orientation of the respective local coordinate 
system (the coordinate frame of a basis, as per section 2.1 , inherently includes an origin 
and orientation). 

As to claim 10, Procter discloses method as claimed in claim 9, wherein the step 
of deriving a basis comprises steps of: deriving a plurality of bases, and selecting at 
least one of the plurality of derived bases (page 890, left column, first 3 lines). 

Regarding claim 1 1 , Procter discloses a method as claimed in claim 10, wherein 
the step of selecting at least one of the plurality of derived bases comprises selecting at 
most two bases derived using any one primitive (page 890, left column, first 3 lines; 
third paragraph of section 3; at least one basis is selected, so at most two bases are 
selected). 

As to claim 1 5, Procter discloses that the step of calculating the 
orientation of the respective local coordinate system comprises steps of: 
selecting one of the primitives used to calculate the origin, and setting the 
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orientation of the coordinate system based on an orientation of the selected 
primitive (since the primitive determines the basis, the orientation of the primitive 
determines the orientation of the coordinate system). 

Regarding claim 18, Procter discloses method as claimed in claim 2, wherein the 
step of representing each of the primitives as invariants in the derived basis comprises 
a step of calculating parameters of each primitive relative to a respective local 
coordinate system of the derived basis (first paragraph of section 3; the angles are 
inherently invariant with respect to the basis). 

Regarding claim 28, Procter discloses a method of deriving a model use in a 
pattern matching method in accordance with claim 1, the method comprising steps of: 

deriving at least one model primitive representative of large scale structures of an 
archetype (section 3; fig.1); 

sampling each model primitive at two or more respective sample locations (page 
890, right column, first paragraph; sampling is provided by two projections for each 
edge-triple); 

mapping each sample location to a respective sample bin of a hash table (page 
890, right column, first paragraph); and 

inserting a reference to the respective model primitive in the sample bin (page 
890, right column, first paragraph). 
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Allowable Subject Matter 

6. Claims 6-8, 1 2-1 4,16-17,1 9-27 and 29-30 are objected to as being dependent 
upon a rejected base claim, but would be allowable if rewritten in independent form 
including all of the limitations of the base claim and any intervening claims. 

Conclusion 

THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .1 36(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Contact Information 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Jon Chang whose telephone number is (571) 272-7417. 
The examiner can normally be reached on M-F 8:00 a.m.-6:00 p.m.. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Amelia Au can be reached on (571)272-7414. The fax phone number for 
the organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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Primary Examiner 
Art Unit 2623 



Jon Chang 
May 29, 2005 



